An initial investigation on the use of fractional calculus with neural networks

نویسندگان

  • Sam Gardner
  • Robbie Lamb
  • John Paxton
چکیده

The widely used backpropagation algorithm based on stochastic gradient descent suffers from typically slow convergence to either local or global minimum error. This backpropagation algorithm bears great resemblance to a classic proportional integral derivative (PID) control system. Fractional calculus shows promise for improving stability and response in feedback control through the use of non-integer order derivatives and integrals. In this paper, the application of fractional calculus to backpropagation is explored as a means for improving speed and performance.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A Nonlinear Creep-damage Constitutive Model of Mudstone Based on the Fractional Calculus Theory

During the flood development in an oil field, the creep characteristic of mudstone is one of the important factors causing casing damage. In this study, based on the theory of fractional order differential and taking into account the creep damage evolution rules, a fractional nonlinear creep-damage model is proposed to reflect the instantaneous deformation in loading processes and the accelerat...

متن کامل

SLIDING MODE CONTROL BASED ON FRACTIONAL ORDER CALCULUS FOR DC-DC CONVERTERS

The aim of this paper is to design a Fractional Order Sliding Mode Controllers (FOSMC)for a class of DC-DC converters such as boost and buck converters. Firstly, the control lawis designed with respect to the properties of fractional calculus, the design yields an equiv-alent control term with an addition of discontinuous (attractive) control law. Secondly, themathematical proof of the stabilit...

متن کامل

Some new results using Hadamard fractional integral

Fractional calculus is the field of mathematical analysis which deals with the investigation and applications of integrals and derivatives of arbitrary order. The purpose of this work is to use Hadamard fractional integral to establish some new integral inequalities of Gruss type by using one or two parameters which ensues four main results . Furthermore, other integral inequalities of reverse ...

متن کامل

A distinct numerical approach for the solution of some kind of initial value problem involving nonlinear q-fractional differential equations

The fractional calculus deals with the generalization of integration and differentiation of integer order to those ones of any order. The q-fractional differential equation usually describe the physical process imposed on the time scale set Tq. In this paper, we first propose a difference formula for discretizing the fractional q-derivative  of Caputo type with order  and scale index . We es...

متن کامل

Positive solutions for discrete fractional initial value problem

‎‎In this paper‎, ‎the existence and uniqueness of positive solutions for a class of nonlinear initial value problem for a finite fractional difference equation obtained by constructing the upper and lower control functions of nonlinear term without any monotone requirement‎ .‎The solutions of fractional difference equation are the size of tumor in model tumor growth described by the Gompertz f...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2006